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ABSTRACT 

This study was conducted to examine particular metacognitive 
monitoring and regulatory skills (Knowledge of Cognition, Objectivity, 

Problem Representation, Subtask Monitoring, and Evaluation) in the context of 
solving science problems within a computer-based learning environment. The 
study also attempted to replicate the results of H. Swanson's (1990) study, 
which examined the interactions between problem-solving outcomes for students 
categorized according to high and low levels of metacognition and high and 
low levels of aptitude. Participants were 1,163 students in grades 5 through 
12 from schools across the United States. Overall, the total score for 
metacognitive monitoring and regulatory skills was a significant predictor of 
both Content Understanding and Problem Solving, Three of the five factors 
(Knowledge of Cognition, Objectivity, and Problem Representation) were 
significant predictors of Content Understanding. Four of the five factors 
(Knowledge of Cognition, Objectivity, Problem Representation, and Evaluation) 
were significant predictors of problem solving. Results also show that those 
with high Metacognitive Self-Regulation compensated for low aptitude on both 
Content Understanding and Problem Solving measures. Implications for 
instruction and research are discussed. The instrument is attached. (Contains 
6 tables and 20 references.) (SLD) 
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Abstract 

Research from several quarters has shown that metacognitive monitoring and control are 
important skills for successful problem solving (e.g., Artzt & Armour-Thomas 1992; Carr & 
Jessup, 1997; Hmelo & Cote, 1996; Tobias & Everson, 1995). In particular, research has 
demonstrated that self-regulation and use of metacognitive skills predicts problem solving 
success as well as or better than traditional predictors of general ability such as achievement 
scores (Swanson, 1990). 

The purpose of this research study was to examine particular metacognitive monitoring 
and regulatory skills (Knowledge of Cognition, Objectivity, Problem Representation, Subtask 
Monitoring, and Evaluation) in the context of solving science problems within a computer-based 
learning environment. We also sought to replicate the results of Swanson’s (1990) study, which 
examined the interactions between problem solving outcomes for students categorized according 
to high and low levels of metacognition and high and low levels of aptitude. 

Overall, the total score for metacognitive monitoring and regulatory skills was a 
significant predictor of both Content Understanding and Problem Solving. Three of the five 
factors (Knowledge Of Cognition, Objectivity, & Problem Representation) were significant 
predictors of Content Understanding. In addition, four of five factors (Knowledge Of Cognition, 
Objectivity, Problem Representation, & Evaluation) were significant predictors of Problem 
Solving. Results also showed that those with High Metacognitive Self-Regulation compensated 
for Low Aptitude on both Content Understanding and Problem Solving measures. 

These results have several implications for researchers and classroom educators alike. 
Most researchers in the learning sciences agree that metacognition and self-regulation are 
important predictors of student success in school. The research briefly presented here helps to 
justify such claims by demonstrating that particular metacognitive self-regulation variables are 
important for success in both content understanding and problem solving. It is our hope that such 
research will eventually lead to the development of a model for problem-solving activities and 
materials that would foster metacognitive self-regulation. 



Background 

Metacognitive Self-Regulation 

Various definitions and models of self- regulated learning abound in the research 
literature (Bruning, Schraw and Ronning, 1995). Zimmerman (1989) captured the sweeping 
purview of self-regulated learning when he said, “Students can be described as self-regulated to 
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the degree that they are metacognitively, motivationally, and behaviorally active participants in 
their own learning process” (p.4). 

For this study, we concentrated on what it means to be a “metacognitively active 
participant” in the process of scientific problem solving. In particular, we examined five facets 
of metacognitive self-regulation: 

• Knowledge of Cognition : understanding the extent and utilization of one’s unique 
cognitive abilities and the ways one learns best. 

• Objectivity : standing outside oneself and thinking about one’s learning as it proceeds. 

• Problem Representation : understanding the problem fully before proceeding. 

• Subtask Monitoring : breaking the problem down into subtasks and monitoring the 
completion of each subtask. 

• Evaluation : double-checking throughout the entire problem-solving process to evaluate if 
it is being done correctly. 

Metacognition and Problem Solving 

In 1990 H. Lee Swanson presented a pivotal work linking metacognition to successful 
problem solving. Swanson set out to demonstrate the independence of metacognition and 
general aptitude on various problem-solving measures. He measured aptitude with standardized, 
cognitive ability and achievement tests. He measured metacognitive ability using tape-recorded 
responses to a metacognitive questionnaire. His findings indicated that metacognition was more 
important for problem-solving success than aptitude and that in situations where students had 
low aptitudes but high metacognition, they performed as well as students who had high aptitude. 
The implications of this finding are numerous given the strong emphasis placed on aptitude by 
educators throughout the history of psychological measurement. 

We believe the implications of Swanson’s research are especially pertinent to science 
education with its emphasis on problem solving. Some could argue that aptitude is innate and, 
therefore, largely unchangeable through instructional interventions. Like aptitude, metacognition 
may also be innate. Unlike aptitude, however, many would argue that metacognition may be 
more susceptible to change. That is, at the very least, regulatory behaviors such as goal-setting 
and selection of learning strategies, can be taught. If these can be taught, this gives promise to 
the notion that students of low aptitude may be taught strategies and behaviors that would lead to 
success at problem solving comparable to students of higher aptitude. 

Recent research has demonstrated similar findings. At the University of California at 
Berkeley in a project for physics education. White and Frederiksen (1998) demonstrated that 
teaching students monitoring behaviors (to promote metacognition) improved student 
performance significantly. Tn particular, their results revealed that low-achieving students 
demonstrated outcomes similar to those who were typically higher achieving. Thus, the model 
treatment helped to reduce the educational disadvantage that low-achieving students often face 
and provided for greater equity across all students. 

In addition, research in science education is indicating that a variety of regulatory 
behaviors may be learned and that such behaviors are beneficial for learning. For example, 
research has shown that certain behaviors lead to success in science education, such as 
identifying goals (Linn 1995), self-assessing (White & Frederiksen, 1995), planning (King, 

1988; Scardamalia & Bereiter, 1991), self-explaining (Chi, Bassok, Lewis, Reimann, & Glaser 
1989), self-questioning (King 1994), reflecting (Davis, 1998; Audet, Hickman & Dobrynina, 
1996), and making concepts personally relevant (Linn, 1995). In addition, in numerous studies 
concerned with training students to use cognitive strategies, Pressley and colleagues have found 
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their instructional method to have significant benefits in the area of reading comprehension (e.g. 
Pressley, Schuder, Bergman, & El-Dinary, 1992). 

Our own research in testing educational theory in actual classrooms has revealed 
implications for strategies to promote metacognition. For example, research using the CET- 
developed CD-ROM Astronomy Village®: Investigating the Universe provided the first 
evidence that students may not necessarily need nor use high levels of metacognition to solve 
every type of problem (Hong, 1998). This research indicated that metacognitive awareness was 
a significant predictor of success for ill-structured problem solving, but was not significant for 
solving well-structured problems. 

Research Questions 

In this study, we sought to investigate which components of metacognitive self-regulation 
are most important for scientific problem solving. We hypothesized that five facets of 
metacognitive self-regulation, as measured by the Inventory of Metacognitive Self-Regulation 
(Howard, McGee & Shia 1999), would predict success at problem solving. By examining the 
facets, we hoped to create a descriptive profile of the components of metacognitive self- 
regulation that are most important for problem solving. Further, we sought to replicate the results 
of Swanson’s (1990) study which examined the interactions between problem solving outcomes 
for students categorized according to high and low levels of metacognition and high and low 
levels of aptitude. We predicted that the results would be congruent, that is, that high levels of 
metacognitive self-regulation could compensate for low overall aptitude. 

Method 

Participants 

Participants included I 163 students, grades 5-12 from schools across the U.S. 
representing a cross-section of socioeconomic backgrounds and urban/suburban/rural 
categorizations. The ethnic breakdown included 80.5% Caucasian, 10.2% Asian American, 

5.4% African American, 2.8% Hispanic or Latino, and 3.8% Other. By gender, the breakdown 
was 5 1 .4% male, 48.6% female. 

Procedure/ Materials 

Students used the Astronomy Village software for an average of 20 instructional periods. 
Students were given pretest/posttest instruments that measured learning: One instrument 
measured Content Understanding , and the other measured Problem Solving . 

At pretest time, students also took the Inventory of Metacognitive Self-Regulation 
(IMSR) which measures five factors related to awareness of learning processes and control of 
learning strategies: (1) Knowledge Of Cognition, (2) Objectivity (3) Problem Representation, (4) 
Subtask Monitoring, and (5) Evaluation (Howard, McGee & Shia, 1999). The IMSR includes 32 
items that use a five-point Likert scale. For each of the 32 items, students are instructed to circle 
the answer that best described the way they are when solving problems in math or science class 
(l=never, 2=seldom/rarely, 3=sometimes, 4=often/frequently, 5=always). The validation of the 
IMSR and a more detailed explanation of the five factors is discussed elsewhere (Howard, 

McGee & Shia, 1999). 



Results 

Our first hypothesis was that each of the five facets of metacognitive self-regulation 
would predict success at problem solving. Overall, the IMSR total score was a significant 
predictor of both Content Understanding and Problem Solving (6 = . 144, p=.000 and R = . 176, 
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p=.000, respectively). See Table 1 for details. Three of the five factors (Knowledge Of 
Cognition, Objectivity, & Problem Representation) were significant predictors of Content 
Understanding. In addition, four of five factors (Knowledge Of Cognition, Objectivity, Problem 
Representation, & Evaluation) were significant predictors of Problem Solving. See Tables 2 & 3 
for details. See Table 4 for an overview of these findings. 



Insert Tables 1, 2, 3, & 4 about here 



Our second hypothesis was that high levels of metacognitive self-regulation would 
compensate for low overall aptitude. For aptitude, we used student GPAs converted to ^-scores 
for comparison between schools. (In the final version of this paper, we will also include analyses 
on additional aptitude measures derived from student achievement test scores.) Students were 
grouped into high and low categories on aptitude and metacognitive self-regulation using the top 
and bottom 28%. Two 2x2 ANOVAs were conducted (High v. Low Aptitude X High v. Low 
Metacognitive Self-Regulation). In terms of Content Understanding, there was a significant 
interaction. Our hypothesis was supported in that those with High Metacognitive Self- 
Regulation (HM) compensated for Low Aptitude (LA) (LA/HM=HA/HM > HA/LM). In terms 
of Problem Solving, there was also a significant interaction, supporting our hypothesis (HA/HM 
> HA/LM = LA/HM> LA/LM). See Tables 5 and 6 for details. 

Implications 

The research presented here has several implications for researchers and classroom 
educators alike. Most researchers in the learning sciences agree that metacognition and self- 
regulation are important predictors of student success in school. The research briefly presented 
here helps to justify such claims by demonstrating that particular metacognitive self-regulation 
variables are important for success in both content understanding and problem solving. 

The Five Facets of Metacognitive Self-Regulation 

The fact that three of the metacognitive self-regulation variables (Knowledge Of 
Cognition, Objectivity, & Problem Representation) were related to content understanding has 
important implications for theory related to self-regulated learning. First, our results indicate 
that Knowledge of Cognition is related to Content Understanding — a finding which has 
heretofore not been reported. Secondly, our results add credence to the construct validity of 
Objectivity & Problem Representation as important self-regulatory variables. We recommend 
that these variables should be more widely subjected to academic or experimental scrutiny to 
confirm their importance. The fact that the two facets (Subtask Monitoring and Evaluation) were 
not predictors of Content Understanding is in line with prior research indicating that certain 
regulatory variables are only moderately correlated with domain knowledge if at all. That is, 
lower-level learning may not require high degrees of self-regulation. 

Knowledge Of Cognition, Objectivity, Problem Representation, & Evaluation were 
significant predictors of Problem Solving. . In retrospect, we realize that the one non-significant 
variable, Subtask Monitoring, may not have been important for either Content Understanding or 
Problem Solving because the software accomplishes such tasks for the learner. That is, the 
program breaks down problems into manageable chunks and helps students to monitor and 
evaluate completion of those chunks. In terms of the Evaluation factor, we believe it was a 
significant predictor for Problem Solving (but not for Content Understanding) because 
evaluation serves the learner by helping to organize content knowledge and thus solve problems 
more efficiently. This finding is in line with our prior research which demonstrated that well- 
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organized knowledge helps students to apply their content understanding in solving novel 
science problems (Hong, McGee & Howard, 1999). 

Metacognitive Self-Regulation v. Aptitude 

Swanson’s (1990) research has been heralded as a pivot point for research in 
metacognition and problem solving, and is oft-cited in discussions regarding the importance of 
metacognition. The research reported here provides an important confirmation of Swanson’s 
findings and extends it into two new areas. In terms of confirming Swanson’s (1990) work, we 
found congruent results: high levels of metacognitive self-regulation compensated for low 
overall aptitude (in regards to problem solving). In terms of extending Swanson’s (1990) work- 
first, we provide evidence that content understanding is as much a factor of metacognitive self- 
regulation as it is of aptitude. To our knowledge, no prior research has demonstrated such an 
outcome. Second, in our work, we were able to use a short self-report measure for metacognitive 
self-regulation that provided results comparable to the measures Swanson used which required 
think-aloud protocols and extensive coding schemes. 
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Table 1 

Summary of Simultaneous Regression Analyses: IMSR Total as a predictor of Content 
Understanding and Problem Solving (N=829) 



Variables 


B 


SEB 6 


T 


Sig.T 




Content Understanding 


.11 


.02 .14 


4.96 


.000 




Constant 


4.85 


.40 


12.24 


.000 




Problem Solving 


.19 


.03 .18 


6.09 


.000 




Constant 


4.12 


.56 


7.38 


.000 




Table 2 












Summary of Simultaneous Regression Analysis: IMSR Factors as Predictors of Content 


Understanding (N=820) 


Variables 


B 


SEB 


6 


T 


Sig.T 


Knowledge of Cognition 


.48 


.18 


.13 


2.72 


.007 


Problem Representation 


.46 


.15 


.15 


2.98 


.003 


Subtask Monitoring 


.15 


.17 


.05 


.92 


.360 


Evaluation 


.10 


.14 


.03 


.70 


.481 


Objectivity 


-.56 


.14 


-.19 


-4.01 


.000 


Constant 


4.16 


.47 




8.92 


.000 


Note. R 2 = ..07: adi. R 2 =. 06 












Table 3 












Summary of Simultaneous Regression Analysis: IMSR Factors as Predictors of Problem Solving 


CN= 820 V 


Variables 


B 


SEB 


B 


T 


Sig.T 


Knowledge of Cognition 


.61 


.24 


.12 


2.55 


.011 


Problem Representation 


.90 


.21 


.22 


4.38 


.000 


Subtask Monitoring 


.09 


.23 


.02 


.40 


.689 


Evaluation 


.42 


.19 


.11 


2.21 


.027 


Objectivity 


-.95 


.18 


-.23 


-5.18 


.000 


Constant 


3.20 


.64 




5.03 


.000 



Note. R 2 = .10: adj. RV 10 



Table 4 
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Which Facets of Metacognitive Self-Regulation Are Significant Predictors of Content 
Understanding And Problem Solving 





Content 

Understanding 


Problem 

Solving 


Knowledge of Cognition: how much learners understand about the extent and utilization 
of their unique cognitive abilities and the ways they learn best 


* 


* 


Obiectivitv: standing outside oneself and thinking about one’s learning as it proceeds 


* 


* 


Problem Representation: understanding the problem fullv before proceeding 


* 


* 


Subtask Monitoring: breaking the problem down into subtasks and monitoring the 
completion of each subtask 






Evaluation: double-checking throughout the entire problem-solving process to evaluate if 
it is being done correctly 




* 



Table 5 

Content Understanding 





High Metacognitive 
Self-Regulation 


Low Metacognitive 
Self-Regulation 




HA/HM 


HA/LM 


High Aptitude Mean 


7.84 


7.15 


SD 


1.79 


2.59 




LA/HM 


LA/LM 


Low Aptitude Mean 


6.30 


5.94 


SD 


2.20 


2.42 



HA/HM > HA/LM, p=.001 
HA/HM > LA/LM, p=. 000 
LA/HM > LA/LM, p=. 002 



Table 6 

Problem Solving 







High Metacognitive 
Self-Regulation 


Low Metacognitive 
Self-Regulation 






HA/HM 


HA/LM 


High Aptitude 


Mean 


9.46 


8.19 




SD 


2.95 


3.06 






LA/HM 


LA/LM 


Low Aptitude 


Mean 


7.26 


6.05 




SD 


2.94 


2.79 



HA/LM > LA/LM, p=.000 
LA/HM > LA/LM, p=. 050 
HA/HM > LA/LM, p=.000 
HA/HM > HA/LM, p=.015 
HA/HM > LA/HM, p=.000 
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How do You Solve Problems? 



Please read the following sentences and circle the answer that best describes the way you are when 
you are trying to solve a problem. Think about a problem that you might see in a science or math 
class. 



• Think about when you have to solve a hard problem. What do you do before you start? 

• What do you do while you work the problem? 

• What do you do after you finish working the problem? 

There are no right answers— please describe yourself as you are, not how you want to be or think you 
ought to be. Your teacher will not grade this. 

Never Seldom/ Rarely Sometimes Often/ Frequently Always 

ABC D E 



1. I try to understand what the problem is asking me. 

2. I think of several ways to solve a problem and then choose the best one. 

3. I look back at the problem to see if my answer makes sense. 

4. I use different ways to memorize things. 

5. I think to myself, do I understand what the problem is asking me? 

6. I read the problem more than once. 

7. I think about what information I need to solve this problem. 

8. I use different learning strategies depending on the problem. 

9. I look back to see if I did the correct procedures. 

10. I think about how well I am learning when I work a difficult problem. 

11.1 use different ways of learning depending on the problem. 

12. I go back and check my work. 

13. I read the problem over and over until I understand it.. 

14. For this question, please circle letter B. 

15. I check to see if my calculations are correct. 

16. When it comes to learning, I can make myself learn when I need to. 



A B C D 
A B C D 
A B C D 
A B C D 
A B C D 
A B C D 
A B C D 
A B C D 
A B C D 
A B C D 
A B C D 
A B C D 
A B C D 
A B C D 
A B C D 
A B C D 



E 

E 

E 

E 

E 

E 

E 

E 

E 

E 

E 

E 

E 

E 

E 

E 
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Never Seldom/ Rarely Sometimes Often/ Frequently Always 

ABODE 



17. I ask myself how well I am doing while I am learning something new. 

18. I check my work all the way through the problem. 

19. I identify all the important parts of the problem. 

20. I try to understand the problem so I know what to do. 

21. I think about all the steps as I work the problem. 

22. I can make myself memorize something. 

23. When it comes to learning, I know my strengths and weaknesses. 

24. I pick out the steps I need to do this problem. 

25. When I am done with my schoolwork, I ask myself if I learned what I wanted to 
learn. 

26. I double-check to make sure I did it right. 

27. For this question, please circle letter A. 

28. I try to break down the problem to just the necessary information. 

29. I use learning strategies without thinking. 

30. When it comes to learning, I know how I learn best. 

31. I ask myself if there are certain goals I want to accomplish. 

32. I try more than one way to learn something. 



A B C D 
A B C D 

A B C D 
A B C D 
A B C D 
A B C D 
A B C D 
A B C D 
A B C D 

A B C D 
A B C D 
A B C D 
A B C D 
A B C D 
A B C D 
A B C D 
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